Skip to content

Conversation

danielblando
Copy link
Contributor

What this PR does:
Attempt to fix

==================
WARNING: DATA RACE
Write at 0x0000048e5c08 by goroutine 51695:
  github.com/cortexproject/cortex/pkg/ingester.TestInstanceLimitsUnmarshal()
      /__w/cortex/cortex/pkg/ingester/instance_limits_test.go:11 +0xc8
  testing.tRunner()
      /usr/local/go/src/testing/testing.go:1690 +0x226
  testing.(*T).Run.gowrap1()
      /usr/local/go/src/testing/testing.go:1743 +0x44

Previous read at 0x0000048e5c08 by goroutine 51502:
  github.com/cortexproject/cortex/pkg/ingester.(*Ingester).getInstanceLimits()
      /__w/cortex/cortex/pkg/ingester/ingester.go:3171 +0xdc
  github.com/cortexproject/cortex/pkg/ingester.(*Ingester).updateLoop()
      /__w/cortex/cortex/pkg/ingester/ingester.go:927 +0x5a
  github.com/cortexproject/cortex/pkg/ingester.(*Ingester).updateLoop-fm()
      <autogenerated>:1 +0x47
  github.com/cortexproject/cortex/pkg/util/services.(*BasicService).main()
      /__w/cortex/cortex/pkg/util/services/basic_service.go:190 +0x3b7
  github.com/cortexproject/cortex/pkg/util/services.(*BasicService).StartAsync.func1.gowrap1()
      /__w/cortex/cortex/pkg/util/services/basic_service.go:119 +0x33

Goroutine 51695 (running) created at:
  testing.(*T).Run()
      /usr/local/go/src/testing/testing.go:1743 +0x825
  testing.runTests.func1()
      /usr/local/go/src/testing/testing.go:2168 +0x85
  testing.tRunner()
      /usr/local/go/src/testing/testing.go:1690 +0x226
  testing.runTests()
      /usr/local/go/src/testing/testing.go:2166 +0x8be
  testing.(*M).Run()
      /usr/local/go/src/testing/testing.go:2034 +0xf17
  main.main()
      _testmain.go:221 +0x164

Goroutine 51502 (running) created at:
  github.com/cortexproject/cortex/pkg/util/services.(*BasicService).StartAsync.func1()
      /__w/cortex/cortex/pkg/util/services/basic_service.go:119 +0x1dc
  github.com/cortexproject/cortex/pkg/util/services.(*BasicService).switchState()
      /__w/cortex/cortex/pkg/util/services/basic_service.go:139 +0x115
  github.com/cortexproject/cortex/pkg/util/services.(*BasicService).StartAsync()
      /__w/cortex/cortex/pkg/util/services/basic_service.go:116 +0xb1
  github.com/cortexproject/cortex/pkg/ingester.(*Ingester).StartAsync()
      <autogenerated>:1 +0x5b
  github.com/cortexproject/cortex/pkg/util/services.StartAndAwaitRunning()
      /__w/cortex/cortex/pkg/util/services/services.go:104 +0x49
  github.com/cortexproject/cortex/pkg/ingester.TestIngester_UpdateLabelSetMetrics()
      /__w/cortex/cortex/pkg/ingester/ingester_test.go:[63](https://github.com/cortexproject/cortex/actions/runs/12918817189/job/36029740209?pr=6517#step:6:64)78 +0xa47
  testing.tRunner()
      /usr/local/go/src/testing/testing.go:1690 +0x226
  testing.(*T).Run.gowrap1()
      /usr/local/go/src/testing/testing.go:1743 +0x44
==================
--- FAIL: TestInstanceLimitsUnmarshal (0.01s)
    testing.go:1399: race detected during execution of test

Which issue(s) this PR fixes:
Fixes #

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Signed-off-by: Daniel Deluiggi <[email protected]>
@danielblando danielblando changed the title Fix test Fix TestIngester_UpdateLabelSetMetrics test Jan 23, 2025
@alanprot alanprot marked this pull request as ready for review January 23, 2025 01:05
@dosubot dosubot bot added lgtm This PR has been approved by a maintainer component/ingester labels Jan 23, 2025
@alanprot
Copy link
Member

Thanks!

@danielblando danielblando merged commit 01583d5 into cortexproject:master Jan 23, 2025
16 checks passed
@danielblando danielblando deleted the fix_test branch January 23, 2025 01:06
alexqyle pushed a commit to alexqyle/cortex that referenced this pull request Jan 31, 2025
Signed-off-by: Daniel Deluiggi <[email protected]>
Signed-off-by: Alex Le <[email protected]>
yeya24 added a commit that referenced this pull request Mar 27, 2025
* Purge expired postings cache items due inactivity (#6502)

* Purge expired postings cache items due inactivity

Signed-off-by: alanprot <[email protected]>

* Fix comments

Signed-off-by: alanprot <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Update thanos to 4ba0ba403896 (#6503)

* Update thanos to 4ba0ba403896

Signed-off-by: Daniel Sabsay <[email protected]>

* run go mod vendor

Signed-off-by: Daniel Sabsay <[email protected]>

---------

Signed-off-by: Daniel Sabsay <[email protected]>
Co-authored-by: Daniel Sabsay <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Bump the actions-dependencies group across 1 directory with 2 updates (#6505)

Bumps the actions-dependencies group with 2 updates in the / directory: [actions/upload-artifact](https://github.com/actions/upload-artifact) and [github/codeql-action](https://github.com/github/codeql-action).

Updates `actions/upload-artifact` from 4.5.0 to 4.6.0
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](actions/upload-artifact@6f51ac0...65c4c4a)

Updates `github/codeql-action` from 3.28.0 to 3.28.1
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](github/codeql-action@48ab28a...b6a472f)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: actions-dependencies
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: actions-dependencies
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Alex Le <[email protected]>

* calculate # of concurrency only once at the runner (#6506)

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Implement partition compaction planner (#6469)

* Implement partition compaction grouper

Signed-off-by: Alex Le <[email protected]>

* fix comment

Signed-off-by: Alex Le <[email protected]>

* replace level 1 compaction limits with ingestion replication factor

Signed-off-by: Alex Le <[email protected]>

* fix doc

Signed-off-by: Alex Le <[email protected]>

* update compaction_visit_marker_timeout default value

Signed-off-by: Alex Le <[email protected]>

* update default value for compactor_partition_index_size_limit_in_bytes

Signed-off-by: Alex Le <[email protected]>

* refactor code

Signed-off-by: Alex Le <[email protected]>

* address comments and refactor

Signed-off-by: Alex Le <[email protected]>

* address comment

Signed-off-by: Alex Le <[email protected]>

* address comment

Signed-off-by: Alex Le <[email protected]>

* update config name

Signed-off-by: Alex Le <[email protected]>

* Implement partition compaction planner

Signed-off-by: Alex Le <[email protected]>

* fix after rebase

Signed-off-by: Alex Le <[email protected]>

* addressed comments

Signed-off-by: Alex Le <[email protected]>

* updated doc and refactored metric

Signed-off-by: Alex Le <[email protected]>

* fix test

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Add max tenant config to tenant federation (#6493)

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Add cleaner logic to clean partition compaction blocks and related files (#6507)

* Add cleaner logic to clean partition compaction blocks and related files

Signed-off-by: Alex Le <[email protected]>

* refactored metrics

Signed-off-by: Alex Le <[email protected]>

* refactor

Signed-off-by: Alex Le <[email protected]>

* update logs

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Update RELEASE.md (#6511)

Maintainers would like an additional week to get the partition compactor changes in before the first release candidate for 1.19.

Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* update thanos version to 236777732278c64ca01c1c09d726f0f712c87164 (#6514)

Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Fix race that can cause nil reference when using expanded postings (#6518)

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Add more op label values to cortex_query_frontend_queries_total metric (#6519)

Signed-off-by: Alex Le <[email protected]>

* Allow use of non-dualstack endpoints for S3 blocks storage (#6522)

Signed-off-by: Alex Le <[email protected]>

* Expose grpc client connect timeout config and default to 5s (#6523)

* expose grpc client connect timeout config

Signed-off-by: yeya24 <[email protected]>

* changelog

Signed-off-by: yeya24 <[email protected]>

---------

Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Hook up partition compaction end to end implementation (#6510)

* Implemented partition compaction end to end with custom compaction lifecycle

Signed-off-by: Alex Le <[email protected]>

* removed unused variable

Signed-off-by: Alex Le <[email protected]>

* tweak test

Signed-off-by: Alex Le <[email protected]>

* tweak test

Signed-off-by: Alex Le <[email protected]>

* refactor according to comments

Signed-off-by: Alex Le <[email protected]>

* tweak test

Signed-off-by: Alex Le <[email protected]>

* check context error inside sharded posting

Signed-off-by: Alex Le <[email protected]>

* fix lint

Signed-off-by: Alex Le <[email protected]>

* fix integration test for memberlist

Signed-off-by: Alex Le <[email protected]>

* make compactor initial wait cancellable

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Test for nil on expire expanded postings (#6521)

* Test for nil on expire expanded postings

Signed-off-by: alanprot <[email protected]>

* stopping ingester

Signed-off-by: alanprot <[email protected]>

* refactor the test to not timeout

Signed-off-by: alanprot <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* log when a request starts running in querier (#6525)

* log when a request starts running in querier

Signed-off-by: Ahmed Hassan <[email protected]>

* log when a request starts running in querier for frontend processor

Signed-off-by: Ahmed Hassan <[email protected]>

---------

Signed-off-by: Ahmed Hassan <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Update build image according to 03a8f8c (#6508)

Signed-off-by: Friedrich Gonzalez <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Deprecate -blocks-storage.tsdb.wal-compression-enabled flag

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Fix test (#6537)

Signed-off-by: Daniel Deluiggi <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Mark 1.19 release in progress

https://github.com/cortexproject/cortex/blob/master/RELEASE.md#show-that-a-release-is-in-progress

Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Prepare 1.19.0-rc.0

Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Revert "Prepare 1.19.0-rc.0"

Signed-off-by: Alex Le <[email protected]>

* Fixed blocksGroupWithPartition unable to reuse functions from blocksGroup (#6547)

* Fixed blocksGroupWithPartition unable to reuse functions from blocksGroup

Signed-off-by: Alex Le <[email protected]>

* update tests

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Remove TransferChunks gRPC method (#6543)

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Uupdate Ppromqlsmith (#6557)

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Query Partial Data (#6526)

* Create partial_data

Signed-off-by: Justin Jung <[email protected]>

* Fix lazyquery so that warning message is returned

Signed-off-by: Justin Jung <[email protected]>

* Add QueryPartialData limit

Signed-off-by: Justin Jung <[email protected]>

* Fix broken mock

Signed-off-by: Justin Jung <[email protected]>

* Make response with warnings to be not cached

Signed-off-by: Justin Jung <[email protected]>

* Updated streamingSelect in distributor_queryable

Signed-off-by: Justin Jung <[email protected]>

* Update query.go

Signed-off-by: Justin Jung <[email protected]>

* Update replication_set

Signed-off-by: Justin Jung <[email protected]>

* Lint

Signed-off-by: Justin Jung <[email protected]>

* Lint again

Signed-off-by: Justin Jung <[email protected]>

* Generated doc

Signed-off-by: Justin Jung <[email protected]>

* Changelog

Signed-off-by: Justin Jung <[email protected]>

* Update config description

Signed-off-by: Justin Jung <[email protected]>

* Do not remove warnings from seriesSet

Signed-off-by: Justin Jung <[email protected]>

* Avoid cache only if the warning message contains partial data error

Signed-off-by: Justin Jung <[email protected]>

* Remove context usage for partial data

Signed-off-by: Justin Jung <[email protected]>

* Refactor how partial data info is passed + apply to series and label methods as well

Signed-off-by: Justin Jung <[email protected]>

* Lint + fix tests

Signed-off-by: Justin Jung <[email protected]>

* Fix build

Signed-off-by: Justin Jung <[email protected]>

* Create separate config for ruler partial data

Signed-off-by: Justin Jung <[email protected]>

* Genereta doc

Signed-off-by: Justin Jung <[email protected]>

* Add more tests

Signed-off-by: Justin Jung <[email protected]>

* Change error

Signed-off-by: Justin Jung <[email protected]>

* Fix test

Signed-off-by: Justin Jung <[email protected]>

* Update changelog

Signed-off-by: Justin Jung <[email protected]>

* Update changelog

Signed-off-by: Justin Jung <[email protected]>

* Nit

Signed-off-by: Justin Jung <[email protected]>

* Nit

Signed-off-by: Justin Jung <[email protected]>

---------

Signed-off-by: Justin Jung <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Add timeout for dynamodb ring kv (#6544)

* add dynamodb kv with timeout enforced

Signed-off-by: yeya24 <[email protected]>

* add tests

Signed-off-by: yeya24 <[email protected]>

* docs

Signed-off-by: Ben Ye <[email protected]>

* update changelog

Signed-off-by: Ben Ye <[email protected]>

---------

Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Ben Ye <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Bump the actions-dependencies group across 1 directory with 2 updates (#6564)

Bumps the actions-dependencies group with 2 updates in the / directory: [github/codeql-action](https://github.com/github/codeql-action) and [actions/setup-go](https://github.com/actions/setup-go).

Updates `github/codeql-action` from 3.28.1 to 3.28.7
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](github/codeql-action@b6a472f...6e54559)

Updates `actions/setup-go` from 5.2.0 to 5.3.0
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](actions/setup-go@3041bf5...f111f33)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: actions-dependencies
- dependency-name: actions/setup-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: actions-dependencies
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Alex Le <[email protected]>

* Fix: expanded postings can cache wrong data when queries are issued "in the future" (#6562)

* improve fuzz test for expanded postings cache

Signed-off-by: alanprot <[email protected]>

* create more tests on the expanded postings cache

Signed-off-by: alanprot <[email protected]>

* adding get series call on the test

Signed-off-by: alanprot <[email protected]>

* no use CachedBlockChunkQuerier when query time range is completely after the last sample added in the head

Signed-off-by: alanprot <[email protected]>

* adding comments

Signed-off-by: alanprot <[email protected]>

* increase the number of fuzz test from 100 to 300

Signed-off-by: alanprot <[email protected]>

* add get series fuzzy testing

Signed-off-by: alanprot <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Extend ShuffleSharding on READONLY ingesters (#6517)

* Filter readOnly ingesters when sharding

Signed-off-by: Daniel Deluiggi <[email protected]>

* Extend shard on READONLY

Signed-off-by: Daniel Deluiggi <[email protected]>

* Remove old code

Signed-off-by: Daniel Deluiggi <[email protected]>

* Fix test

Signed-off-by: Daniel Deluiggi <[email protected]>

* update changelog

Signed-off-by: Daniel Deluiggi <[email protected]>

---------

Signed-off-by: Daniel Deluiggi <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Create guide doc for partition compaction

Signed-off-by: Alex Le <[email protected]>

* Update docs/guides/partitioning-compactor.md

Co-authored-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* updated doc

Signed-off-by: Alex Le <[email protected]>

* clean white space

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>
Signed-off-by: Daniel Sabsay <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Ahmed Hassan <[email protected]>
Signed-off-by: Friedrich Gonzalez <[email protected]>
Signed-off-by: Daniel Deluiggi <[email protected]>
Signed-off-by: Justin Jung <[email protected]>
Signed-off-by: Ben Ye <[email protected]>
Signed-off-by: Alex Le <[email protected]>
Co-authored-by: Alan Protasio <[email protected]>
Co-authored-by: Daniel Sabsay <[email protected]>
Co-authored-by: Daniel Sabsay <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: SungJin1212 <[email protected]>
Co-authored-by: Charlie Le <[email protected]>
Co-authored-by: Ben Ye <[email protected]>
Co-authored-by: Sam McBroom <[email protected]>
Co-authored-by: Ahmed Hassan <[email protected]>
Co-authored-by: Friedrich Gonzalez <[email protected]>
Co-authored-by: Daniel Blando <[email protected]>
Co-authored-by: Justin Jung <[email protected]>
justinjung04 added a commit to justinjung04/cortex that referenced this pull request Mar 27, 2025
* Purge expired postings cache items due inactivity (cortexproject#6502)

* Purge expired postings cache items due inactivity

Signed-off-by: alanprot <[email protected]>

* Fix comments

Signed-off-by: alanprot <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Update thanos to 4ba0ba403896 (cortexproject#6503)

* Update thanos to 4ba0ba403896

Signed-off-by: Daniel Sabsay <[email protected]>

* run go mod vendor

Signed-off-by: Daniel Sabsay <[email protected]>

---------

Signed-off-by: Daniel Sabsay <[email protected]>
Co-authored-by: Daniel Sabsay <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Bump the actions-dependencies group across 1 directory with 2 updates (cortexproject#6505)

Bumps the actions-dependencies group with 2 updates in the / directory: [actions/upload-artifact](https://github.com/actions/upload-artifact) and [github/codeql-action](https://github.com/github/codeql-action).

Updates `actions/upload-artifact` from 4.5.0 to 4.6.0
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](actions/upload-artifact@6f51ac0...65c4c4a)

Updates `github/codeql-action` from 3.28.0 to 3.28.1
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](github/codeql-action@48ab28a...b6a472f)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: actions-dependencies
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: actions-dependencies
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Alex Le <[email protected]>

* calculate # of concurrency only once at the runner (cortexproject#6506)

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Implement partition compaction planner (cortexproject#6469)

* Implement partition compaction grouper

Signed-off-by: Alex Le <[email protected]>

* fix comment

Signed-off-by: Alex Le <[email protected]>

* replace level 1 compaction limits with ingestion replication factor

Signed-off-by: Alex Le <[email protected]>

* fix doc

Signed-off-by: Alex Le <[email protected]>

* update compaction_visit_marker_timeout default value

Signed-off-by: Alex Le <[email protected]>

* update default value for compactor_partition_index_size_limit_in_bytes

Signed-off-by: Alex Le <[email protected]>

* refactor code

Signed-off-by: Alex Le <[email protected]>

* address comments and refactor

Signed-off-by: Alex Le <[email protected]>

* address comment

Signed-off-by: Alex Le <[email protected]>

* address comment

Signed-off-by: Alex Le <[email protected]>

* update config name

Signed-off-by: Alex Le <[email protected]>

* Implement partition compaction planner

Signed-off-by: Alex Le <[email protected]>

* fix after rebase

Signed-off-by: Alex Le <[email protected]>

* addressed comments

Signed-off-by: Alex Le <[email protected]>

* updated doc and refactored metric

Signed-off-by: Alex Le <[email protected]>

* fix test

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Add max tenant config to tenant federation (cortexproject#6493)

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Add cleaner logic to clean partition compaction blocks and related files (cortexproject#6507)

* Add cleaner logic to clean partition compaction blocks and related files

Signed-off-by: Alex Le <[email protected]>

* refactored metrics

Signed-off-by: Alex Le <[email protected]>

* refactor

Signed-off-by: Alex Le <[email protected]>

* update logs

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Update RELEASE.md (cortexproject#6511)

Maintainers would like an additional week to get the partition compactor changes in before the first release candidate for 1.19.

Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* update thanos version to 236777732278c64ca01c1c09d726f0f712c87164 (cortexproject#6514)

Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Fix race that can cause nil reference when using expanded postings (cortexproject#6518)

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Add more op label values to cortex_query_frontend_queries_total metric (cortexproject#6519)

Signed-off-by: Alex Le <[email protected]>

* Allow use of non-dualstack endpoints for S3 blocks storage (cortexproject#6522)

Signed-off-by: Alex Le <[email protected]>

* Expose grpc client connect timeout config and default to 5s (cortexproject#6523)

* expose grpc client connect timeout config

Signed-off-by: yeya24 <[email protected]>

* changelog

Signed-off-by: yeya24 <[email protected]>

---------

Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Hook up partition compaction end to end implementation (cortexproject#6510)

* Implemented partition compaction end to end with custom compaction lifecycle

Signed-off-by: Alex Le <[email protected]>

* removed unused variable

Signed-off-by: Alex Le <[email protected]>

* tweak test

Signed-off-by: Alex Le <[email protected]>

* tweak test

Signed-off-by: Alex Le <[email protected]>

* refactor according to comments

Signed-off-by: Alex Le <[email protected]>

* tweak test

Signed-off-by: Alex Le <[email protected]>

* check context error inside sharded posting

Signed-off-by: Alex Le <[email protected]>

* fix lint

Signed-off-by: Alex Le <[email protected]>

* fix integration test for memberlist

Signed-off-by: Alex Le <[email protected]>

* make compactor initial wait cancellable

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Test for nil on expire expanded postings (cortexproject#6521)

* Test for nil on expire expanded postings

Signed-off-by: alanprot <[email protected]>

* stopping ingester

Signed-off-by: alanprot <[email protected]>

* refactor the test to not timeout

Signed-off-by: alanprot <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* log when a request starts running in querier (cortexproject#6525)

* log when a request starts running in querier

Signed-off-by: Ahmed Hassan <[email protected]>

* log when a request starts running in querier for frontend processor

Signed-off-by: Ahmed Hassan <[email protected]>

---------

Signed-off-by: Ahmed Hassan <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Update build image according to cortexproject@03a8f8c (cortexproject#6508)

Signed-off-by: Friedrich Gonzalez <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Deprecate -blocks-storage.tsdb.wal-compression-enabled flag

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Fix test (cortexproject#6537)

Signed-off-by: Daniel Deluiggi <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Mark 1.19 release in progress

https://github.com/cortexproject/cortex/blob/master/RELEASE.md#show-that-a-release-is-in-progress

Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Prepare 1.19.0-rc.0

Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Revert "Prepare 1.19.0-rc.0"

Signed-off-by: Alex Le <[email protected]>

* Fixed blocksGroupWithPartition unable to reuse functions from blocksGroup (cortexproject#6547)

* Fixed blocksGroupWithPartition unable to reuse functions from blocksGroup

Signed-off-by: Alex Le <[email protected]>

* update tests

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: Alex Le <[email protected]>

* Remove TransferChunks gRPC method (cortexproject#6543)

Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Uupdate Ppromqlsmith (cortexproject#6557)

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Query Partial Data (cortexproject#6526)

* Create partial_data

Signed-off-by: Justin Jung <[email protected]>

* Fix lazyquery so that warning message is returned

Signed-off-by: Justin Jung <[email protected]>

* Add QueryPartialData limit

Signed-off-by: Justin Jung <[email protected]>

* Fix broken mock

Signed-off-by: Justin Jung <[email protected]>

* Make response with warnings to be not cached

Signed-off-by: Justin Jung <[email protected]>

* Updated streamingSelect in distributor_queryable

Signed-off-by: Justin Jung <[email protected]>

* Update query.go

Signed-off-by: Justin Jung <[email protected]>

* Update replication_set

Signed-off-by: Justin Jung <[email protected]>

* Lint

Signed-off-by: Justin Jung <[email protected]>

* Lint again

Signed-off-by: Justin Jung <[email protected]>

* Generated doc

Signed-off-by: Justin Jung <[email protected]>

* Changelog

Signed-off-by: Justin Jung <[email protected]>

* Update config description

Signed-off-by: Justin Jung <[email protected]>

* Do not remove warnings from seriesSet

Signed-off-by: Justin Jung <[email protected]>

* Avoid cache only if the warning message contains partial data error

Signed-off-by: Justin Jung <[email protected]>

* Remove context usage for partial data

Signed-off-by: Justin Jung <[email protected]>

* Refactor how partial data info is passed + apply to series and label methods as well

Signed-off-by: Justin Jung <[email protected]>

* Lint + fix tests

Signed-off-by: Justin Jung <[email protected]>

* Fix build

Signed-off-by: Justin Jung <[email protected]>

* Create separate config for ruler partial data

Signed-off-by: Justin Jung <[email protected]>

* Genereta doc

Signed-off-by: Justin Jung <[email protected]>

* Add more tests

Signed-off-by: Justin Jung <[email protected]>

* Change error

Signed-off-by: Justin Jung <[email protected]>

* Fix test

Signed-off-by: Justin Jung <[email protected]>

* Update changelog

Signed-off-by: Justin Jung <[email protected]>

* Update changelog

Signed-off-by: Justin Jung <[email protected]>

* Nit

Signed-off-by: Justin Jung <[email protected]>

* Nit

Signed-off-by: Justin Jung <[email protected]>

---------

Signed-off-by: Justin Jung <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Add timeout for dynamodb ring kv (cortexproject#6544)

* add dynamodb kv with timeout enforced

Signed-off-by: yeya24 <[email protected]>

* add tests

Signed-off-by: yeya24 <[email protected]>

* docs

Signed-off-by: Ben Ye <[email protected]>

* update changelog

Signed-off-by: Ben Ye <[email protected]>

---------

Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Ben Ye <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Bump the actions-dependencies group across 1 directory with 2 updates (cortexproject#6564)

Bumps the actions-dependencies group with 2 updates in the / directory: [github/codeql-action](https://github.com/github/codeql-action) and [actions/setup-go](https://github.com/actions/setup-go).

Updates `github/codeql-action` from 3.28.1 to 3.28.7
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](github/codeql-action@b6a472f...6e54559)

Updates `actions/setup-go` from 5.2.0 to 5.3.0
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](actions/setup-go@3041bf5...f111f33)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: actions-dependencies
- dependency-name: actions/setup-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: actions-dependencies
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Alex Le <[email protected]>

* Fix: expanded postings can cache wrong data when queries are issued "in the future" (cortexproject#6562)

* improve fuzz test for expanded postings cache

Signed-off-by: alanprot <[email protected]>

* create more tests on the expanded postings cache

Signed-off-by: alanprot <[email protected]>

* adding get series call on the test

Signed-off-by: alanprot <[email protected]>

* no use CachedBlockChunkQuerier when query time range is completely after the last sample added in the head

Signed-off-by: alanprot <[email protected]>

* adding comments

Signed-off-by: alanprot <[email protected]>

* increase the number of fuzz test from 100 to 300

Signed-off-by: alanprot <[email protected]>

* add get series fuzzy testing

Signed-off-by: alanprot <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Extend ShuffleSharding on READONLY ingesters (cortexproject#6517)

* Filter readOnly ingesters when sharding

Signed-off-by: Daniel Deluiggi <[email protected]>

* Extend shard on READONLY

Signed-off-by: Daniel Deluiggi <[email protected]>

* Remove old code

Signed-off-by: Daniel Deluiggi <[email protected]>

* Fix test

Signed-off-by: Daniel Deluiggi <[email protected]>

* update changelog

Signed-off-by: Daniel Deluiggi <[email protected]>

---------

Signed-off-by: Daniel Deluiggi <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* Create guide doc for partition compaction

Signed-off-by: Alex Le <[email protected]>

* Update docs/guides/partitioning-compactor.md

Co-authored-by: Charlie Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>
Signed-off-by: Alex Le <[email protected]>

* updated doc

Signed-off-by: Alex Le <[email protected]>

* clean white space

Signed-off-by: Alex Le <[email protected]>

---------

Signed-off-by: alanprot <[email protected]>
Signed-off-by: Alex Le <[email protected]>
Signed-off-by: Daniel Sabsay <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: Charlie Le <[email protected]>
Signed-off-by: yeya24 <[email protected]>
Signed-off-by: Ahmed Hassan <[email protected]>
Signed-off-by: Friedrich Gonzalez <[email protected]>
Signed-off-by: Daniel Deluiggi <[email protected]>
Signed-off-by: Justin Jung <[email protected]>
Signed-off-by: Ben Ye <[email protected]>
Signed-off-by: Alex Le <[email protected]>
Co-authored-by: Alan Protasio <[email protected]>
Co-authored-by: Daniel Sabsay <[email protected]>
Co-authored-by: Daniel Sabsay <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: SungJin1212 <[email protected]>
Co-authored-by: Charlie Le <[email protected]>
Co-authored-by: Ben Ye <[email protected]>
Co-authored-by: Sam McBroom <[email protected]>
Co-authored-by: Ahmed Hassan <[email protected]>
Co-authored-by: Friedrich Gonzalez <[email protected]>
Co-authored-by: Daniel Blando <[email protected]>
Co-authored-by: Justin Jung <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/ingester lgtm This PR has been approved by a maintainer size/XS
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants